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! Abstract 

o 

I The problem of many hypotheses logarithmically asymptotically optimal (LAO) 

testing for a model consisting of three or more independent objects is solved. It is 
supposed that M probability distributions are known and each object independently of 
others follows to one of them. The matrix of asymptotic interdependencies (reliability- 
\^ ■ reliability functions) of all possible pairs of the error probability exponents (reliabilities) 

! in optimal testing for this model is studied. 

This problem was introduced (and solved for the case of two objects and two given 
probability distributions) by Ahlswede and Haroutunian. The model with two inde- 
pendent objects with M hypotheses was explored by Haroutunian and Hakobyan. 
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Index Terms - Hypothesis testing, multiple hypotheses, logarithmically asymptotically optimal 
(LAO) tests, two independent objects, error probability, reliability function. 



I. Introduction 



\q [ In [T] (see also [2], |3]) Ahlswede and Haroutunian formulated an ensemble of new prob- 

lems on multiple hypotheses testing for many objects and on identification of hypotheses. 
Noted problems are extentions of those investigated in the books [I] and [H]. Problems of 
identification of distribution and of distributions ranking for one object were solved in [2] 
completely. Also the problem of hypotheses testing for the model consisting of two inde- 
pendent or two strictly dependent objects (when they cannot admit the same distribution) 
with two possible hypothetical distributions was investigated in j2j. In this paper we study 
the model consisting of K(> 3) objects which independently follow to one of given M(> 2) 
probability distributions. The problem is a generalization of those investigated in papers 
[6 JU], and for testing of many hypotheses concerning one object in [TT]. The case of 
two independent objects with three hypotheses was examined in ^2]- Recently Tuncel ^3] 
published an interesting consideration of the problem of multiple hypothesis optimal testing, 
which differs from the approach of ^T], |14j . 

Let V(X) be the space of all probability distributions (PDs) on finite set X. There are 
given M PDs G m G V(X), m = T^M. 

Let us recall main definitions from ^1] for the case of one object. The random variables 
(RV) X taking values on X follows to one of the M PDs G m , m = 1,M. The statistician 
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must accept one of M hypotheses H m : G = G m , m = l,M, on the base of a sequence 
of results of N observations of the object x = {x\, x n , xjy), x n G X, n = 1,N. The 
procedure of decision making is a non-randomized test <pw, which can be defined by division 
of the sample space X N on M disjoint subsets Af = {x : <p N (x) = I}, I = 1,M. The set 
Af contains all vectors x for which the hypothesis Hi is adopted. The probability a m \i{ip^) 
of the erroneous acceptance of hypothesis Hi provided that H m is true, is equal to G^(Af), 
I ^ m. The probability to reject H m , when it is true, is 

(<Pn) = a m\li.^N)- (1) 

The error probability exponents of the sequence of tests ip, which it is convienient to call 
"reliabilities", are defined as 



E m \i{tp) = Hm - — log a m \i((p N ), m,l = l,M. (2) 



It follows from (I) that 



Em\m(<P) = W*-Em\i(tp), m=l,M. (3) 

The matrix E(y?) = {E m \i((p)} is the reliability matrix of the sequence ip of tests. It was 
studied in [TTj . 

Definition: We call the sequence of tests (p* logarithmically asymptotically optimal (LAO) 
if for given positive values of M — 1 diagonal elements of the matrix E(<p*) maximal values 
to all other elements of it are provided. 

The concept of LAO test was introduced by L. Birge [TU] and also elaborated in [TT] . 
[TJ] and [Hj. Now let us consider the model with three objects. Let X 1; X 2 and X 3 be 
independent RV taking values in the same finite set X with one of M PDs, they are char- 
acteristics of corresponding independent objects. The random vector (Xi, X 2 , X 3 ) assumes 
values ( s ) e x x x x x. 

Let (xi,X2,X3) = ((xj, x\, x^), {x\i x^, x^), (x]y, x* N , %n G X, k = 1,3, n = 

1, N, be a sequence of results of iV independent observations of the vector (A 1; X 2 , X 3 ). It is 
necessary to define unknown PDs of the objects on the base of observed data. The decision 
for each object must be made from the same set of hypotheses: H m : G = G m , m = 1, M . 
We call this procedure the test for three objects and denote it by It can be considered 
as three sequences of tests ip 1 , ip 2 , tp 3 by one for each object. We will denote the compound 
test sequence by $. When we have K independent objects the test $ is composed of K 
sequences of tests ip 1 , ip 2 ,..-, ip K ■ 

Let a miim2im 3|i li z 2i i 3 ($Ar) be the probability of the erroneous acceptance by the test $at of 
the hypotheses triple (H^, Hi 2 , Hi 3 ) provided that the triple (H mi , H m2 , H m3 ) is true, where 
(mi, m 2 , 777,3) 7^ {h,h,h)j m i-,h = l,Af, i — 1,3. The probability to reject a true triple of 
hypotheses (H mi , H m2 , H m3 ) by analogy with (1) is the following: 

^7711 ,rri2 ,rri3 |mi ,m2 ,rri3 

( 4 ) 

(ii,i2,i3)^(mi,m2,m3) 
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We study corresponding limits E mum2>m3 \i u i 2j i 3 (Q>) of error probability exponents of the se- 
quence of tests $, called reliabilities 



E mijm2jm3 \i uhM (^) = \im - ^\oga mum2)m3 \ ll)hM (^ N ), m h k = l,M, z = l,3. (5) 
It follows from (5) that (compare with (3)) 

E mi! m2 t m3\mi,m,2,m3 ( < ^ ) ) = n^F 11 , -^Wi ,m2 ,ro3 Ul ,£2 ,^3 ( < ^ > ) • (6) 

('l I «2,<3)^( m l. m 2,™.3) 

For the case of K objects the error probability and reliability are considered also in papers 
PP PJ. The test sequence $* is called LAO for the model with K objects if for given positive 
values of certain K(M — 1) elements of the reliability matrix E(<&*) the procedure provides 
maximal values for all other elements of it. 

Our aim in this paper is to analyze the reliability matrix E($*) = {E mi ^ m2 ^ m . i \i 1 ^ 2) i 3 {^*)} 
of LAO tests for three objects. The first idea was to study matrix E($) by renumbering 
the triples of PD-s from 1 to M 3 . We can give M 3 — 1 diagonal elements of matrix E($) 
and apply Theorem 1. In this case the number of preliminary given elements of the matrix 
E($) will be grater and the procedure of calculations will be longer than in the algorithm 
presented in Section 3. 

The generalization of the problem for K independent objects will be discussed during 
the text and in Section 4. 
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II. LAO Testing of Hypotheses for One Object 

We define the divergence (Kullback-Leibler distance) D(Q\\G) for PDs Q,G E V(X), as 
usual (see [T5j): 

WI|G) = £Q(*)logg|j. 

We need to remind the Theorem and its Corollaries from ^l] for the convenience to have 
notations. 

For given positive elements Em, E 2 \2, ■ • ■ , ^m-iIm-i we denote 



ft, = {Q:D(Q||G,)<£i|i}, / = 1,M-1, (7.o) 

M-l 

11m = {Q : D{Q\\Gi) > E l]h / = 1, M — 1} = V(X) — (J K h (7.b) 

i=i 

and consider the following values: 

A 



E! ll = E: il (E lll ) = E llh l = M-l, (8.a) 
E* m{l = E* mll (E llt ) ^ ird D(Q\\G m ), m = TjM, m^l, l = l,M-l, (8.6) 



Qelli 



K\m = K\m(Ei\i,...,E m _ iIM _ 1 )= inf D(Q\\G m ), m = l,M-l, 
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e m\m = e m\m( e i\ii ■ ■ -,Em-i\m-i) = min E*,,,. (S.d) 

1 1 l=l,M-l 1 



Theorem 1 f77]/ : If the distributions G m , m — 1, M, are different, that is all elements of the 
matrix {D(Gi\\G m )}, are strictly positive, then two statements hold: 
a) when the given numbers E±\i, E 2 \2, ■ ■ ■ , E M _i\ M _i satisfy conditions 

0<Ei»< min. D(Gi\\G l ), (9.a) 

l=2,M 



< E m]m < min[ min E^JE^), min D(Gi\\G m )], m = 2,M-l, (9.6) 

l=X,m-l l=m+l,M 

then there exists a LAO sequence of tests (p*, the reliability matrix of which E (<£>*) = {E^n} 
is defined in (8) and all elements of it are strictly positive; 

b) even if one of conditions (9) is violated, then the reliability matrix of any such test 
includes at least one element equal to zero (that is the corresponding error probability does 
not tend to zero exponentially). 
Corollary 1 [12]: It can be proved that 



E* m \m = E* m \M, m=l,M-l,and E* m{m ? E* m{l , l^m,M. (10) 
Proof: Applying theorem of Kuhn- Tucker in (8.b) we can derive that the elements E*, t , 



/ = 1, M — 1 may be determined by elements E^u, m ^ I, m — 1,M, by the following 
inverse function 

E*JE* mll )= inf D{Q\\Gi). 

i|(V m|i/ Q:D(Q\\G m )<E* mll 

From conditions (9) we see that E^ m can be equal only to one among E^, I — m + 1, M. 
Assume that (10) is not true, that is E\ m = E^, for I — m+l,M — 1. From (8.b) it 
follows that 

EUE* m{l )= inf D{Q\\Gi)= inf D(g||G,) = E* {m , 

l ^ m| ' 7 Q:D(Q\\G m )<E* mll Q:D(Q\\G m )<E* m{m ' |m 



m = l,M-l,l = l,M-l,m<l, 



but from conditions (9) it follows that E*^ < E^ m for m = 1, 1 — 1. Our assumption is not 
correct, hence (10) is valid. 

Corollary 2 [12]: If one preliminary given element E m \ m , m = 1,M — 1, of the reliability 
matrix of an object is equal to zero, then the corresponding elements of the matrix determined 
as functions of E m \ m , will be define as in the case of Stain's lemma |15j : 



E' llm (E mlm ) =D(G m \\G l ), l = l,M, l^m, (11) 



and the remaining elements of the matrix are defined by Em > 0, I ^ m, I — 1, M — 1, as 
follows from Theorem 1. 

Remark 1: The number of elements E m \ m equal to zero may be any between 1 and M — 1. 
Generalization of Corollary 2 is straightforward. 
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III. LAO Testing of Hypotheses for Three Independent Objects 

Now let us consider the case of three independent objects and M hypotheses. The compound 
test $ may be compoused from three separate tests (p 1 , p 2 , p 3 . 

Let us denote by E(<^ 1 ) the reliability matrices of the sequences of tests p\ i = 1,3, for 
each of the objects. The following Lemma is a generalization of Lemma from [T] and |12j . 
Lemma 1: If elements E m \i(p l ), m, I = 1, M, i = 1,3, are strictly positive, then the following 
equalities hold for $ = (tp 1 , p> 2 , p 3 ): 

3 

E mi , m2 , m3 \h,i 2 ,i 3 {^) ^J^^ilki^ 1 ): if m ii^h, « = T73, (12. a) 

i=i 

E mi ,m 2 ,m 3 \h,l 2 ,l 3 (^) = ^ E m i \li( ( P % ) > m k = k, ™i ^ k, 1^ k, %, k = 1, 3, (12.6) 

i: 

E mi ,m3,m 3 \h,h,h(^) = Emilkiv 1 ), m k = l k , nii ^ U, i ^ k, k, i = 1, 3. (12. c) 

Equalities (12. a) are valid also if E m \i(p l ) = for several pairs (to, I) and several i. 
Proof: It follows from the independence of the objects that 

3 

Oi mi) m 2 ,m 3 \h,l 2 ,l 3 (^N) = J\0L mi \ k {p) l N ), if TOj 7^ Zj, (13. a) 

i=l 

a mi ,m 2 , m3 \h,l 2 ,h(®N) = (l-Ot mk \l k (iPN))n° l m i \l i (<P l N)> m k = k, m ± h, %, k = 1^3, 

i+k 

(13.6) 

a mi ,m 2 ,m 3 \h,i 2 ,i 3 (®N) = atm^VN) ~~ Kfc (^V ) ) ) m k = h, to* ^ k,k,i = 1,3. (13. c) 

Remark that here we consider also the probabilities of right (not erroneous) decisions. 
According to the definitions (4) and (5) from equalities (13) we obtain relations (12). 

Now we shall show how we can find LAO test from the set of compound tests {$ = 
(p l ,p> 2 ,p 3 )} when strictly positive elements E m ^ m \ M , m , m , E m ,m, m \™M,™ and Em, m ,m\m,m,M, 
to = 1, M — 1, of the reliability matrix are given. 

Lemma 2: These elements can be strictly positive only in the following three subsets of tests 

{<S> = (p\p 2 ,p 3 )}: 

A = {$ : £ w , m (^) > 0, to = 1, M - 1, 2 = 1,3}, 

B = {$ : one or several m' from [1, M — 1] exist such that E m t\ m t(ip l ) = for two i, 
but # m /| m ,(^) > 0, z 7^ j, and for other m < M, E m \ m (p l ) > 0, i, j = 1, 3}, 
C = {$ : one or several to' from [1,M — 1] exist such that E m i\ m i(p l ) = 0, and 

and for other m < M, E m \ m (p l ) > 0, % — 1,3}. 

Proo/ : When E m \ m {p> 1 ) > 0, then 

Jim - ^- log(l - a m | m ((^ 1 )) = 0, m = l,M, z = l,3. 
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and when E m \ m (ip l ) = 0, then 



lim - — log(l - a m \ m ((p % )) > 0, m = l,M, i = l,3. 

From these equalities and inequalities, keeping in mind (5), (10) and (13) we obtain that 
the given elements are positive for $ e A{J B{J C. Proposition 1 is proved. 

Let us define the following family of decision sets for given positive elements E m ^ m \ M ^ m , 
E m,m,m\m,M,m and E mmm \ mjn M , Tfl — 1, A/ 1: 



= {<? : D(Q\\G m ) < £ m ,m,™|mi,m 2 ,m 3 > mi = M, TTlj = m, iy^j,}, 771 = 1, M - 1 i = 1,3, 

7^2 = {Q : I)(Q||G m ) > S m>m>m | mi)ma>m3 , ?7ii = M, mj =m, i 7^ j, m = 1,M - 1}, i = T73. 



Let also 



p* — p 

*^m,m,m\m,m,M ~ ^m^m^m^M 5 

E m,m,m\m,M,m = E m,m,m\m,M,mi (14. a) 

P* — P 

a m,m,m\M,m,m ~ ■ Cj m,m,m\M,m,m,i 



E *m m rn 3 \hfr,h= mi D(Q\\G mi ) , rrik = h, rm^li,i^k, i,k = l,3, (14.6) 
E m u m 2 ,m 3 \h,h,m3 == Yl mi D(Q\\G mi ) , m k = l k , ^ k, i, k = 1^3, (14.c) 



(0 
U 



E mi,m2,mz\h,l2,h E mi,m.2,mz\h,m2,mz + E m,\,mi,mz\m\,li,mz + E m\,m2,mz\mx,m.2,l?, ' m i h- (14.0?) 

The result of the present paper is formulated in 
Theorem 2: If all distributions G m , m = 1, M, are different, (and consequently D(G/| |G m ) > 
0, / ^ m, I, m — 1, M), then the following three statements are valid: 

a) when given strictly positive elements £ m , m , m | m , m ,M, £m,m,mK™,M and £ m , m , m |M,m,m, 
m = 1, M — 1, meet the following conditions 

max(£?i ) i ) i|j ltf) i i i,£?i ) i ) i|i )J i tfi i,i;i ) i i i|i ) i ) j lf ) < min D(Gi\\G 1 ), (15. a) 

J=2,M 



S m , m , m |M,m,m < min[ min_^ n min D(G t ||G ro )], m = 2, M - 1, (15.6) 

l=l,m-l ' i=m+l,M 



^m,m,m|m,M,m < min [ min_^ | m ; min |G m )], m = 2, M - 1, (15.c) 



^m.m.mlm.m.M < mill [ 5M5_ £ m m mlm m I ) mm D(G, \ \ G m )} , 777 = 2, M - 1, (15(f) 
l=l,m-l l=m+l,M 

then there exists a LAO test sequence $* G ^4, the reliability matrix of which 
E($*) = {-E'mi,m.2,m3|«i,«2,/3( < ^ ) *)} * s defined in (14) and all elements of it are positive, 

b) when even one of the inequalities (15) is violated, then there exists at least one 
element of the matrix E($*) equal to 0, 
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c) for given strictly positive numbers £ m , m , m |M,m,m, E m , m , m \mM,m, and E m ^ m \ m , mM , 
m — 1, M — 1 the reliability matrix E($) of the tests $ from the defined in Lemma 2 families 
B and C necessarily contains elements equal to zero. 

Proof: a) Conditions (15) imply that inequalities analogous to (9) hold simultaneously for 
the case of three objects. Really, using equalities (10) we can rewrite inequalities (9) for 
three objects as follows: 

ma,x{E llM {^),E llM {^ 2 ),E llM ^ 3 )) < min £>(G,||Gi), (16.a) 

l=2,M 

E m \M) < minf min E*,M\ min D(G } \\G m )l i = M, m = 2, M - 1, (16.6) 

J=l,m-1 J=m+1,M 

We shall prove, for example, the inequalities (16.6), for z = 2 which are the consequence 
of the inequalities (15. c). Let us consider the tests $ G A such that -E , m,m,m|m,M,m(3') — 
E m , m ,m\mM,m and £ m , m , m | m ,;, m (<!>) = E^ mMm ^ m , I = l,m - 1, m = 1,M- 1. The corre- 
sponding error probabilities a m , m , m | m ,M,m($Ar) and a m , m , m | m ,/, m ($iv) are given as products 
defined by (13. c). Because $ e A, then 

lim - -J- log(l - a m | m (v?V)) = 0, * = M- (17) 

N^oo iv 

According to (5), (13. c) and (17) we obtain that 

E* m ,m,m\m,M,m(^) = K\ M (<f), ™ = 2, M — 1, (18.a) 
K*,m,m|m A m(^) = ^ = 2, M — 1. (18.6) 

So (16. c) is consequence of (15. c). 

As we noted in the beginning of the proof it follows from (10) and (16) that conditions (9) 
of Theorem 1 take place for each of three objects. According to Theorem 1 there exists LAO 
sequences of tests c/?*' 1 , ip*' 2 and Lp* ,s three objects such that the elements of the matrices 
E((/?*' 1 ), i — 1,3, are determined according to (8). We consider the sequence of tests $*, 
which is composed of three sequences of tests cp*' 1 , tp*' 2 , ip*' 3 and we will show that $* is 
LAO and other elements of the matrix E($*) are determined according to (14). 

It follows from (16), (10) and (9) that the requirements of Lemma 1 are fulfilled. Applying 
Lemma 1 we can deduce that the reliability matrix E($*) can be obtained from matrices 
E(v?*' i ) as in (12). 

When conditions (15) take place, we obtain (14) according to (12), (8), (10) and (18). 
The equality in (14. e) is a particular case of (6). From (14) it follows that all elements of 
E($*) are positive. 

Now it is easy to verify that the compound test $* for three objects is LAO. 

b) When one of the inequalities (15) is violated, then from (14. b) we see, that some 
elements in the matrix E($*) must be equal to zero. 

c) When $ G £>, then from (10) and (12. a) we can see that the elements -E , m ',m',m'|Af,M,M = 

3 

E E m ,\ M ((p) = 0. 
i=i 
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Let $ = (if 1 , ip 2 , (p 3 ) G C. For example E^^iif 1 ) > 0, E m ,\ m <{^ 2 ) = £ m /| m /(y? 3 ) = 0, 
then 

E m ',m',m'\m',M,M = J im ~ "T7 log(l - OWlm'^)) + E m >\ m i{ip 2 ) + £ m /| m /(y2 3 ) = 0. 
N — >oo iv 

Theorem 2 is proved. 

Remark 2: For every test $ from noted in Lemma 2 subset C (for the case of subset B 
resonemets are similar) for given 3(M — 1) elements of matrix E($), using independence of 
three objects, the definition (4) and equalities (10) we can determine all other elements of 
E($) in the following way: 

^ m ', m ',m'|M, m ',m'($) = Jim - -j- log(l - a m , | m , ( v? 3 ) ) + Jim - \- log(l - aw| m >(y? 2 )) > 0, 

^m',m',m'|m',M,m'( $ ) = J im ~ T7 ^gt 1 - « m '|m'(^)) + Jim - -[- log(l - OW|m'(</? 3 )) > 0, 

^m',m',m'|m',^',^( $ ) = J im ~ 7? lo §( 1 ~~ OWlm'^)) + J im ~ T7 ^gl 1 ~ OWK^ 2 )) > °- 

A/ — >oo iv A/ — >oo iv 

From these equalities it follows that 

N— >oo iv 

= 2[^ , m',m',m'|m'. M ^'(^ > ) + ^m'.m'^'lm'.™'^^) — ^Tn',m',m'|M,m',m'($)], (19. a) 

~~ ^ - ®m>\m>{p 2 )) = 

N— >oo iv 

[^m',m',m'|M,m',m'(^) + -^m',m',m'|m'.m'.^( < ^) ~~ -^m',m',m'|m'^»™' (^)l ' (19.6) 
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Jim - -J- log(l - a m > K (y? 3 )) = 

N^oo iv 



2 

Hence 



,m',m'|M,m',m' 

($) + £ m , 

,m' ,m'\m' ,M,m' 

($) - E m , 

,m' ,m'\m' ,m' ,M ($)], (19.c) 



^ mi ,m 2 ,m3l«i,;2,i 3 ( $ ) = ^mxl/^V 1 ) +^m 2 |« 2 (^ 2 ) +^m3|«3(¥ ?3 ) ) m i 7^*, 1 = 1,3, (20.d) 

E mi ,m 2 ,m 3 \h,h,h(^) = S ^m,|i,(v^ 3 ), if ™* 7^ Zj, m fc = Z fc , fc 7^ i. (20.6) 
Denoting right sums from (19. a) by A, from (19. b) by B, from (19. c) by C we obtain that 

E m ' im2 ,TO3 \m',fa,l3 

($) = S m2 | i2 (^ 2 ) + E m3 \ h (ip s ) + A, m 2 ^ Z 2 , m 3 + Z 3 , 

Emi,m' ,m3\h,m' ,ls 

($) = E rnAh (p l ) + E m3ll3 (<p 3 ) + B, mi ^ Zi, m 3 ^ Z 3 , (20.c) 
^mi ,m 2 ,m' | ( i ,/ 2 ,m' ($) = ^mi|ii(v ) + E m2 \h(tp ) + C, mi ^ Zi, m 2 ^ Z 2 , 

E m ' ,m' ,m' \m' ,m' ,M i 
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E m ',m 2 ,m'\m',h,m'(&) ~ E m3 \i 3 ((p ) + ^m' ,m! ,m'\m' ,M,m' , (20. d) 

E mi ,m',m'\h,m',m'(&) = E m3 \i 3 ((p 3 ) + E m > >m ^ m i\ M>m > >m > . 

Remember that in this case the elements E m > >m i , m '\M,M,M(&) = 0. From (20) we see, that 
LAO test $' = (v?' 1 , if' 2 , if' 3 ), m' e [1,M - 1] is composed of the tests (p n , (p 12 and ip' 3 
discussed in Corollary 2. 

IV. Supplements for K(>)3 Objects 

When we consider the model with K independent objects the generalization of Lemma 
1 will take the following form: 

Lemma 3: If elements E m u((p l ), m,l = 1,M, i = 1,K, are strictly positive, then the 
following equalities hold for $ = (ip 1 , tp 2 , <p K ): 

K 

E mum2t ..., mK \i uht ...,i K ($) =^2E miVi ((p t ), if rrii^li, i = l^K, 

z=i 

E mi ,m2,...,m K \hM,...,l K (^) = S if m 3 = l h m i ^ l i, ij, i,j = l,K. 

i: ij^j 

For given if(M - 1 ) strictly positive elements £ m , m ,..., m |M ) m ) ...,m, £m,m,...,m|m,M,...,m, •-, 
^m,m...,m|m,...,m,Af,) m — 1, M — 1 for the case of X independent objects. We can find the 
LAO test $* we will find as in the case of three independent objects. So the problem 
of many hypotheses testing of the model with K independent objects may be solved by 
constricting corresponding sets R$, k = l,K, m — 1,M as in (14) and formulating 
conditions analogical to (15). 

It is interesting to analyse the generalization of Corollary 2 for the case of many objects. 

V. Example 

Let us consider an example on LAO testing hypotheses concerning one object and two 
objects. The set X = {0, 1} of two elements and the following probability distributions 
given on X: G x = {0, 10; 0, 90}, G 2 = {0, 85; 0, 14}, G 3 = {0, 23; 0, 77}. In Fig. 1 and Fig. 2 
the results of calculations of functions £2|i(-Ei|i) and £ , 2,i|i,2(-E'i,i|3,i, ^2,212,3) are presented. 
For these distributions we have min(D(G , 2, Gi), D(G%, G\)) ~ 2, 2 and 
min(£ l 2 i 2|2,i, D(Gs, G2)) ~ 1, 4. We see that when the first inequality in (9. a) is violated then 
E 2 \i = and, when the inequality (15. b) and (15. c) are violated, then £"2,111,2 = 0. 
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